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COMPUTER GRAPHICS IN MOTION 


Computer animation has been in 
development and use for years, but only 
recently has become a common feature 
of our visual world. We see it in movies, 
TV commercials and video games. 


There are hundreds of computer 
animation techniques just as there are 
hundreds of ways to make music. To 
help understand these techniques, we 
can group the computer animation 
systems into categories, just as musical 
instruments are grouped into wood- 
winds, strings, percussion and brass. 


In this article we will discuss seven 
generic systems as illustrated in 
Figure 1. 


All the computer animation systems 
that we will look at are composed of at 
least two component parts: the com- 
puter and a drawing device. The draw- 
ing device makes the images which are 
photographed onto film or videotaped. 
The computer controls the drawing pro- 
cess by sending the device electronic 
signals, and the artist controls the 
computer. 


There are two kinds of computers: 
Analog and Digital. Usually when we 
use the word computer, we're talking 
about digital computers. These are the 
ones that send out utility bills and run 
video games. 


Few people have even heard of 
analog computers, because when we 
encounter one, it's called something 
other than a computer. An electronic 
musical synthesizer, for example, is 
actually an analog computer. 


Since the machine is not usually call- 
ed a computer, calling the work produc- 
ed with it computer animation has led 
to a confusion betwen analog and 
digital work. Rather than argue the 
semantics of the term ‘computer anima- 
tion,’ we'll consider techniques based 
‘on both kinds of computers. 


PART 1—ANALOG SYSTEMS 
1. OSCILLOGRAPHICS 


Analog computers were being.used 
by artists to make films as early as the 
1950s. Figure 2 is from a film by Hy 
Hirsch. The system used to create this 
film consists of an analog computer and 
an oscilloscope, and the technique is 
called oscillographics. 
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OVERVIEW OF SEVEN COMPUTER ANIMATION SYSTEMS 
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Figure 3 


An oscilloscope is a screen and a 
beam of electrons which hits the screen 
and draws a point of light. The point of 
light can be controlled in three ways. 
The beam’s position is controlled by 
turning 2 knobs, one for Horizontal 
movement and one for Vertical move- 
ment. A third knob controls the Intensi- 
ty of the beam, and consequently the 
brightness of the point on the screen. 


Instead of using knobs, we can at- 
tach wires to these functions and con- 
trol them by changing the voltage in the 
wire. Thus, the amount of voltage flow- 
ing in the wire substitutes for the ‘posi- 
tion’ of the knob, and determines the 
position of the beam. 


The position of the beam is analogous 
to the amount of voltage in the wire. 
That's why this is called an analog 
system. In digital systems, numbers are 
used to specify the position of the 
beam rather than voltage levels. The 
pattern of voltage channels in the wire 
is called an electronic signal. 


So the problem of making drawings 
on an oscilloscope is a matter of 
generating electronic signals. This can 
be accomplished with an electronic 
music synthesizer. The classic music 
synthesizer (such as Moog, Buchla or 
Arp) is an analog computer. 

The film or video artist creates 
animating images on the scope by 
generating signals with the music syn- 
thesizer and using them to control the 
movement of the beam. 


This process of composing an elec- 
tronic signal by patching modules 
together with cables is used on all 
analog systems. The differences are 
in how that signal is used to make 
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2. IMAGE PROCESSOR 


By generating two independent 
signals and using them to control the 
vertical and horizontal movements, a 
pattern can be formed which complete- 
ly fills the screen from top to bottom 
with horizontal lines. This is the scan- 
ning pattern used in video and the pat- 
tern is called Raster scan. 


A television picture tube is similar to 
an oscilloscope except that the horizon- 
tal and vertical motion is fixed in such a 
way so that the beam is constantly 
scanning out a raster pattern. If the 
horizontal and vertical movements are 
fixed, then that leaves only the Inten- 
sity signal to form the image. 


Variations in the beam’s intensity dur- 
ing the scan produces an image com- 
posed of various shades of grey. The 
levels of grey in the image range from 
black to white and correspond to the 
range of possible intensity levels. 


If we use signals generated with a 
synthesizer to control the intensity, then 
variations in the voltage level of the 
signal will result in variations in grey 
level. This is how a video synthesizer 
forms an image. The image in Figure 3 
is from Electronic Masks by Barbara 
Sykes and was produced with the 
Sandin Image Processor (Figure 4). 


3. SCAN PROCESSOR 


The next analog system we'll discuss 
is the scan processor. Video artist 
Woody Vasulka used a scan processor 
to produce the image in Figure 5. A 
scan processor, like the music syn- 
thesizer system, uses an oscilloscope- 


an image. 


like display. 


A 
Figure 5 


In a scan processor, the raster is 
scanned as in video, but unlike standard 
video, the pattern can be modified by 
the user. Any of the three signals form- 
ing the raster pattern (vertical move- 
ment, horizontal movement, and intensi- 
ty) can be modified. These modifica- 
tions can come from either synthesized 
signals or a video camera. 


In both of the video synthesizers 
we've looked at, image processors and 
scan processors, signals could be 
generated internally or with video 
cameras. 


An image processor is designed to 
process the image as encoded in the 
standard video signal (that is, the inten- 
sity signal only). A scan processor, on 
the other hand, can actually alter the 
scanning pattern itself (that is, it can 
modify the horizontal and vertical 
movements of the beam). 


If the scanning pattern is modified, 
then the result is no longer a standard 
video signal. (So, it can’t be fed directly 
to a TV or tape recorded.) The results 
appear on an oscilloscope-like display 
and so scan processors belong with 
oscillographics on our chart (Figure 1). 
And just like oscillographics, to be 
recorded the screen must be filmed or 
rescanned with a video camera. 


If rescanned with a video camera, 
then a video signal is created which can 
be processed with an image processor. 
So you could produce an image on a 
scan processor and process it and col- 
orize it on an image processor. 


These two functions are combined in 
a single system called the Scanimate, 
which was developed by Lee Harrison in 
the late 60's. Ron Hays used a 
Scanimate system to create his 
videotape Canon (Figure 6). 


REAL TIME VS. CONVENTIONAL 
ANIMATION 


In the systems covered so far, we've 
seen analog computers used to 
generate and process electronic signals. 
These signals were used to drive two 
types of displays: oscilloscopes and 
video monitors. With each of these two 
displays we could see the images mov- 
ing on the screen in front of us. This 
display could then be filmed or video- 
taped like a live action scene. Should 
we Call this animation, though? 
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Figure 6 


In any film, what we see as a moving 
image is really a series of stills projected 
in sequence at great speed: 24 per sec- 
ond. In live action, those stills were 
created by the camera capturing a 
series of snapshots of the constantly 
changing real world at the same speed 
as projection: 24 per second. 


In conventional animation, each of 
these stills is a photograph of a draw- 
ing. The drawings are placed on an 
animation stand and photographed, one 
at a time. When projected back at 24 
frames a second, movement is syn- 
thesized. Film is the mechanism which 
allows us to project at great speed 
drawings which were created and 
photographed at slow speed (or one at 
a time). 


In contrast to conventional animation, 
the systems we've looked at so far 
create and display the sequence of 
images at high speed so movement is 
visible directly on the display. 


This is called Real Time Animation. 
The sequence of images is being pro- 
duced and displayed at a speed which 
produces the illusion of movement. This 
eliminates the need for film as the 
mechanism of animation. Once a 
sequence of images is visible on the 
screen, then either film or video can be 
used to capture it at live action speed. 


VIDEO ANIMATION 


In conventional frame-at-a-time 
animation, the recording medium must 
be capable of recording in a still- 
frame mode. 


This is easy for a film camera, hard 
for a videotape recorder. So animation 
has traditionally been made on film. 
More recently, single frame videotape 
recording has been developed, making 
‘‘yideo animation’’ possible. 


But this ‘’video animation’’ has been 
confused with work produced on a 
video synthesizer, which has also been 
called “video animation.’’ In one case, 
you have video record single frames, so 
you can shoot drawings with it, and in 
the other, you use video technology 
to synthesize animating images in 
real time. 


4. ANALOG MOTION CONTROL 


The movement in conventional anima- 
tion comes from two sources: 


1) changes in the image from one 
drawing to the next, and 

2) slight movements of the stand be- 
tween exposures to animate pans and 
zooms. These stand movements can be 
automated and controlled with com- 
puters, and since these movements 
alone can create animation, the anima- 
tion stand can be considered a drawing 
device. (see Figure 1) This technique is 
called Motion Control. 


Analog computers, because of their 
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speed, have an advantage over digitial 
computers when it comes to generating 
real time animation. 


But for motion control, which is 
frame-at-a-time animation, you're better 
off with digital computers because of 
their many other advantages. And to- 
day's motion control systems are all 
digital. Still, the first motion controlled 
stand used an analog computer. It was 
called The Whitney Cam Machine. Mo- 
tion Control techniques opened the door 
to a whole new world of special effects 
magic in Hollywood. When the movie 
Star Wars came out in 1977, it started 
a science fiction craze in Hollywood 
feature films with dazzling effects like 
the jump into ‘‘hyperspace.’’ 


This jump into ‘‘hyperspace’’ effect is 
called a streak, and was invented by 
John Whitney, Sr., who invented mo- 
tion control in the 1950's by building 
the first computer-controlled animation 
stand in his garage with an army 
surplus analog computer. 


The analog computer controls the 
movement of the artwork which is back 
lit on a light table. The film camera 
looks down from above and photo- 
graphs the artwork as it moves. The 
principles of the Whitney Cam Machine 
were copied in machines that Doug 
Trumball built for the 2007 stargate 
corridor sequence, the ones Bob Abel 
built to make TV commercials, and the 
one John Dykstra built for Star Wars. 
Since Star Wars, motion control has 
blossomed into an industry standard, 
but now all systems are controlled with 
digital computers. We'll see them short- 
ly in Part 2 on Digital Computers. 


WHITNEY CAM MACHINE 


The control mechanisms have ad- 
vanced and become quite elaborate 
since motion control was invented, but 
the basic vocabulary of effects was 
established on the Whitney Cam 
Machine: 


1) multiple exposures, 
2) streaks, and 
3) slitscan. 


One benefit of motion control is the 
precise repeatability of animation stand 
movements. This ability can be used to 
produce multiple exposures. If, while 
the shutter is open, an object that emits 
light is moved into several positions and 
its light turned on, then multiple images 
of the object will appear on the film. 


This principle is applied to animation 
in motion control: on an animation 
stand, artwork can be lit from behind. 
When the artwork is moved around in a 
circle and the lights flashed several 
times during the exposure, a multiple 
image is created. This is the technique 
used by James Whitney (John’s 
brother) to produce the film Lapis. 
(Figure 7) 


Another way to use motion control is 


to leave the lights on while the artwork 
is moving. This creates a time exposure 
effect like a photograph of car 
headlights whose movements are visible 
as a streak of light. A film, Terminal 
Self, consisting entirely of streaks was 
made by John’s son, John Whitney, Jr. 


This streak effect has often been 
mistakenly called slitscan, but streak 
and slitscan are two totally different ef- 
fects. The only thing they have in com- 
mon is that they are both time ex- 
posures. Slitscan is a 3rd technique de- 
veloped on the Whitney Cam Machine. 
In slitscan, the artwork is not seen by 
the camera lens all at once. The art- 
work is completely covered except for a 
sliver revealed through a narrow vertical 
slit in the covering. While the camera 
shutter is open for a time exposure the 
slit moves across the artwork and 
reveals it progressively to the camera 
which records an image on film. 

If, during the exposure, there is no 
movement of the artwork or the camera 
but only the slit, then the art appears 
on the film as it would without the 
scanning slit, i.e. normal. However, if 
while the slit is scanning across the art- 
work the camera zooms in toward it, 
then a distortion is introduced: a bulge 
is produced in the figure. For example, a 
rectangle is transformed into a 
trapezoid. 


These three elements of the basic 
vocabulary of the Whitney Cam 
Machine can be found in the later (and 
current) crop of motion controlled 
animation stands that use digital 
computers. 


PART 2 - DIGITAL SYSTEMS 

For each of the 4 types of analog 
animation systems we have covered, 
there was a different KIND of analog 
computer. One was a Scan processor, 
another was an Image processor, and 
so on. 


We'll look at several digital animation 
systems, but only one kind of digital 
computer. That's because all digital 
computers do the same thing fun- 
damentally: they follow lists of instruc- 
tion and can store these lists (and other 
data) internally. 


The major variations among digital 
computers are: 

1) the speed at which they operate, 
and 

2) the size of their internal storage. 
These are usually a function of the size, 
cost, and age of the computer. 


What distinguishes the digital anima- 
tion systems on our chart in Figure 1 is 
the type of display. We'll consider three 
different kinds (vector, raster, and 
animation stands), but they're not 
mutually exclusive; a single system can 
include more than one type of display. 


ANALOG VS. DIGITAL 


The usual method of distinguishing 
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between analog and digital computers is 
by comparing the way they process 
signals internally: analog computers use 
a gradual scale, whereas digital com- 
puters use discrete on-off elements. But 
these characteristics are at a 
microscopic level and do not directly 
affect the user. A more useful distinc- 
tion is at the level of user control. The 
lway in which an instrument's control is 
structured will determine what will be 
easy to do and what will be hard. 


For example, imagine trying to drive a 
car by typing commands on a keyboard, 
or trying to write by guiding a pencil 
with a steering wheel. Clearly, then, the 
control structure of a tool can deter- 
mine its usefulness to a large degree. 


|f we compare the control structures 
of analog and digital computers we 
find... 
Analog computers are controlled by 
routing signals through modules with 
cables, and by turning dials. Digital 
computers can be controlled in a 
number of ways, which may include 
turning dials or drawing with a pen, but 
primarily they're controlled by typing in 
commands at a terminal. A list of these 
commands is a computer program. A 
program is just a description of the 
steps required to complete a task. In 
the past when someone might have 
built a machine to perform a particular 
task, now he only describes the process 
in a program. A digital computer is a 
robot which will exhibit the behavior 
specified by the program and so 
become the machine desired by the 
user. 

This is the most important feature of 
digital computers, and apprently the 
least understod by the computer illit- 
erate. For example, when a TV jour- 
nalist reports a story with the sentence, 
“Some students at MIT have developed 
a computer that can play chess,’’ they 
invariably mean, not that they've built a 
computer but that they’ve developed a 
program. We use the word ‘computer,’ 
to mean a general purpose program- 
mable machine. As soon as it's design- 
ed for a specific purpose, then it’s no 
longer a computer. Also, once a pro- 
gram is stored in a digital computer, you 
can use it at any time in the future. 


With analog systems, the way in 
which the modules are connected is the 
‘program,’ and there’s no way to store 
it. If you take it down so someone else 
can use the machine, you'll have to put 
it back together again next time you 
want to use it. 


And there is another difference be- 
tween analog and digital computers: in 
the analog systems, we saw that 
values, such as how far the beam is to 
be moved on the screen or how bright it 
is, were encoded in the amount of 
voltage in the wires. On digital com- 
puters, when using a vocabulary of 
command to control the display, these 
values are conveyed with numbers. In- 
side the computer, electronic signals are 
used to encode these commands and 


Figure 10 


numbers, but unlike the situation in 
analog systems, the user does not have 
to deal with them as such. 


DIGITAL MOTION CONTROL 


The Analog Cam Machine movements 
are controlled by an electronic signal. 
There is a correspondence between 
amount of voltage in signal and position 
of artwork being moved. 


In the digital system, the animation 
stand is structured the same, but the 
user doesn’t control its movements 
with signals per se. Instead, commands 
are sent via the computer with numbers 
to specify the desired positions of the 
artwork and the camera. For example, 
for a simple streak the program might 
look like this: 


Open shutter 
Zoom IN 50 units 
Close shutter 


This program puts one streak on one 
frame of film. For a stationary image to 
appear on film, this streak must go on 
every frame. So what we want to hap- 
pen is for the computer to repeat this 
sequence of commands once for each 
frame. A 5 second effect lasts 120 
frames, so we add a Repeat command, 
causing this group of commands to be 
repeated 120 times: 


Repeat 120: [Open shutter 
Zoom IN 50 units 
Close shutter 
Zoom OUT 50 units] 


After the frame is exposed, the com- 
mand, Zoom OUT 50 units is used to 
reposition the camera to begin the next 
frame. (There is also an assumption 
here that opening and closing the shut- 
ter advances the film one frame). This 
puts the same streak on each frame, 
producing a static image. For a moving 
streak, we must introduce a slight 
change between frames, such as a 
small vertical movement of the artwork. 
This we do with the command, ‘Move 
UP 2 units”: 

Repeat 120: [Open shutter 
Zoom IN 50 units 
Close shutter 
Zoom OUT 50 units 
Move UP 2 units] 


So as we zoom in and out to streak 
each frame, the artwork slowly moves 
up on the stand and the streak moves 
up in the frame. Multiple exposures and 
slitscan are also produced on digital mo- 
tion control stands. Figure 8 is a 
slitscan image from Ron Hays’ 
videotape Tristan and Isolde. 


6. VECTOR GRAPHICS 


If we look at our chart in Figure 1 
again, we see two types of electronic 
displays: Raster scan and Vector scan. 
The difference between the two is the 
way in which the beam scans the 
screen to create an image (like the dif- 
ference between an oscilloscope and a 
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video monitor). Raster scan, as we 
learned before with analog systems, is 
the name of the scanning pattern that 
video monitors use. The whole screen is 
scanned, one line at a time, from top to 
bottom. The image is formed by varying 
the intensity of the beam during the 
scan. 


A vector scan display, on the other 
hand, is like an oscilloscope, in that the 
image consists of lines (called vectors) 
which are actually drawn by the beam 
as it moves around the screen. 


But again, in digital displays the user 
doesn’t create the signals that control 
the beam. These signals are created in- 
ternally by the display in response to 
commands. The commands instruct the 
display where to draw points and lines 
by means of numerical coordinates. 


There are various kinds of vector scan 
displays and they can be grouped into 
three classes based on three ways of 
recording an animation sequence: film 
recorders, storage tubes, and real time 
displays. 


In a typical film camera, like a Bolex, 
we can identify three ways to shoot 
animation: single frame with a time ex- 
posure, short exposures (still single 
framing) and live action speed. In single 
frame mode, we can shoot time ex- 
posures by holding the release down. 
This holds the shutter open. The second 
way is also single framing, but pushing 
the release gives us a short exposure 
(1/30th sec.) no matter how long we 
hold down the release. And the third 
way, live action speed, is 24 frames per 
second. 


1) time exposure—A film recorder is a 
vector-scan display with a camera 
mounted facing it so a lengthy drawing 
process can be captured on each frame 
of film as a time exposure (not unlike 
the streaking process of motion 
control). 


Since the drawing accumulates on 
the film over time, it can’t be seen in its 
entirety by the user until the film is 
developed. This isn’t very convenient, 
so these displays are usually used in 
conjunction with another type of display 
which can be used for previewing the 
image. This type of display is called a 
storage tube. 


2) short exposure (but still frame-at-a- 
time)— The storage tube display has a 
screen which retains the image of the 
points and lines as they’re being drawn 
instead of allowing them to fade, so 
that the user can see the whole draw- 
ing all at once and a camera can record 
the drawing on one frame of film with a 
short exposure (rather than a time ex- 
posure). 


The process is still one-frame-at-a- 
time-animation, though. You can see in- 
dividual drawings, but you can’t see 
movement until the film is developed 
and projected. There are displays on 
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which you can see movement directly 
without filming, and they're called real 
time displays. 


3) live action speed—Real time 
displays draw and redraw images fast 
enough to see the animation without 
filming or taping (just like the process 
we saw in the analog systems). Figure 
9 is from my film 3/78 which was 
animated on a real time system. 


Since the vector images are animating 
in real time, we can point a video 
camera at the display and process the 
signal with an Image Processor. Figure 
10 is from Spiral 5 by Tom DeFanti and 
Dan Sandin and was produced on a 
system which combines real time vector 
graphics and image processing. 


SOFTWARE VS. HARDWARE 


Regardless of how the image is cap- 
tured on film, the programming is a 
function of the main computer and the 
software available for it. The word 
‘Software’ has two connotations. One 
contrasts Software with the word 
‘Hardware.’ Hardware consists of all 
the pieces of the system which are 
material objects, such as the main com- 
puter, the display, the terminal, the 
printer, the disc drive and so on. Soft- 
ware, in this context, is the information 
that is stored in the various memory 
devices. Software includes programs 
which help you edit other programs, 
programs that draw pictures, or data 
such as the numbers in a phone book. 


But in another context, like the 
phrase ‘Software Development,’ the 
word software does not refer to data, 
but to a class of programs which are 
designed specifically as tools. A pro- 
gram which helps you edit text, for in- 
stance, is a software tool. Software, in 
this sense of the word, can determine 
how useful a piece of hardware will be 
for a particular task. Software has a 
hierarchical nature which allows users 
to extend the tools provided, with their 
own. This is one of the more powerful 
aspects of digital computers and it 
doesn’t exist in analog. This extendable 
nature of software makes it unique 
among man’s tools in that the tool user 
can also be the tool builder. 


7. RASTER GRAPHICS 

Each of the three methods of record- 
ing animation (on film or tape) that we 
identified for vector graphics, apply to 
raster graphics as well, namely: 


1) time exposures—The same film 
recorder that’s used for vector graphics 
is capable of operating in a raster mode, 
too. As in the vector mode, each frame 
in a sequence is stored on film via a 
time exposure. Figure 11 is from a com- 
mercial produced by Digital Effects us- 
ing a film recorder. 


2) short exposure (frame-at-a-time) — 
In vector graphics, a storage tube was 
used to preview images and to avoid 
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the need for time exposures during film- 
ing. But there is no such comparable 
screen that can store a raster image. So 
the problem of disappearing images is 
solved by creating a special section of 
the computer's memory (called a frame 
buffer) for the storage of the data re- 
quired to draw one frame. The display 
screen is constantly refreshed from the 
data in this frame buffer memory. So, 
as the main computer builds the image 
by changing the numbers stored in the 
frame buffer, the results are con- 
tinuously visible on the screen. 


The resolution of a frame buffer is 
measured in number of pixels. The word 
pixel is a contraction of Picture Ele- 
ment. The pixels fill the screen the way 
squares fill a page of graph paper. The 
finer the grid of your graph paper, the 
smaller is each pixel and the more you 
have. The more pixels, the higher the 
resolution. 


For each pixel on the screen, there is 
a number stored in the frame buffer 
which determines the shade of grey (or 
color) for that pixel. Changing the 
number assigned to a pixel changes its 
shade (or color). The range of numbers 
is limited and determines how many col- 
ors are possible for any pixel. Since this 
number is stored in binary form, its size 
is measured in number of bits per pixel. 
But you don’t need to know binary 
arithmetic to compute the resolution of 
a frame buffer—just this relationship: 1 
bit means 2 colors, 2 bits means 4 col- 
ors, 3 bits, 8 colors and so on. The 
amount of memory devoted to each pix- 
el (in number of bits) is a measure of 
the color resolution of the buffer. The 
complete resolution of the buffer, then, 
would combine spatial and color, and 
would be specified as number of pixels 
Wide by number of pixels High by 
number of bits per pixel, or Depth. For 
example, the resolution of the frame 
buffer in the Datamax Zgrass computer 
is 320 Wide x 201 High x 2 bits/pix- 
el. (Figure 12) High resolution frame 
buffers were used by Ed Emshwiller to 
produce his videotape, Sunstone. 


3) live action action speed—If these 
buffers can be updated fast enough, 
then the animation can be seen in real 
time. From video games to flight 
simulators, real time animation is re- 
quired when the images must respond 
to human interaction. Stan Vanderbeek 
used the flight simulator at NASA’s 
Houston center to create the images of 
his film, Euclidean Mlusions, in real time. 

The difference in resolution, realism 
and visual quality between video games 
and flight simulators is obviously enor- 
mous. This reflects the large difference 
in size and cost of the computers. But 
as these factors continue to drop, who 
can say how long it will be before play- 
ing a Star Trek computer game will look 
like being IN Star Trek, the movie? 


A videotape of this presentation will 
be soon available. For more information 
write: Larry Cuba, 1803 Mission Street 
#123, Santa Cruz, CA 95060. 
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